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SUBTRACT TOP RIGHT DIFFERENCE CALCULATION 
(CACHE [x] [y-INTEREST WINDOW HEIGHT]) 
FROM INTEREST COLUMN SUM ARRAY [x] 



COMPUTE 

DIFF TEMP = ABS (INPUT (x,y)-INPUT (x+1^)) 
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STORE DIFF TEMP IN CACHE [x] £/] 8>78> 
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ADD DIFF TEMP TO INTEREST COLUMN SUM ARRAY [y] 



Fig. 35(A) 
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SUBTRACT INTEREST COLUMN SUM ARRAY fx- 
INTEREST WINDOW WIDTH ] FROM SSD [x] £/] 












ADD INTEREST COLUMN SUM 
ARRAY [x] TO SSD [x] [y] 


_&B1 



INTEREST 
RESULT [x] (jy] = O 
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INTEREST 
RESULT [x] [y] = 1 ~~ ' 



NEXT COLUMN, OR IF END 
OF ROW, BEGINNING 
COLUMN OF NEXT ROW 



^ RETURN "y ^ 386 
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Fig. 35(D) 



DATA PACKING 
INTERMEDIATE TEMP 1 



j COMPARISON OF LEFT 

I ( x+2*z y ) WITH RIGHT ( Xl y ) 
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COMPARISON OF LEFT 
( x+2*z,y ) WITH RIGHT ( xj/ ) 



INTERMEDIATE TEMP 2 



INTERMEDIATE TEMP I 



COMPARISON OF LEFT 
( x+2*z+1 WITH RIGHT ( x,y ) 
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INTERMEDIATE TEMP 2 



. COMPARISON OF LEFT 
( x+2* Zl y ) WITH RIGHT ( x,y ) 
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INTERMEDIATE TEMPI 




COMPARISON OF LEFT 
( x+2*z+1,y ) WITH RIGHT ( x,y ) 


INTERMEDIATE TEMP 1 


COMPARISON OF LEFT 
( x+2*z,y ) WITH RIGHT ( x,y ) 


COMPARISON OF LEFT 
( x+2*z+ly ) WITH RIGHT ( x,y ) 
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CONSISTENCY 
CHECK 



("start "V." 
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PERFORM THE FOLLOWING FOR 
EACH IMAGE ELEMENT 
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INCR = O 
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BEST LR SCORE = CORRELATION SUM [ x+D-HNCR]fcy] 
BEST LR INDEX = D-1-INCR 
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INCR = INCR + 1 |-~724 
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CURRENT CORRELATION SUM SCORE = CORRELATION 
SUM [x+D*INCR+D-1-INCR](>/] 
OR ALTERNATIVELY FOR 3-DIMENSIONS. 
CURRENT CORRELATION SUM SCORE = CORRELATION 
SUM [x+INCR](y][D-1-INCR] 
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DETERMINE MODE FILTER 
WINDOW SIZE 



MODE FILTER 



REGIONS 1 - 6 

APPLY APPROPRIATE MODE FILTER OPERATION | — ' ' 
BASED ON THE LOCATION OF THE REFERENCE 
IMAGE ELEMENT OF THE MODE FILTER WINDOW 



GO TO REGION 
DEFINED 3Y REGIONS 7 

a, s, 10 
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GO TO ROWlLf OA 



GOTO 
COLUMN J 



NEXT COLUMN J 



NEXT ROW I 
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FIG. 30(A) ( RETURN ) 
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MOPE FILTER 



IF REFERENCE IMAGE ELEMENT (I .J) OF 
THE MODE FILTER WINDOW IS IN 
REGION 7, PERFORM REGION 7 MODE 
FILTER OPERATION 







IF REFERENCE IMAG 
THE MODE FILTE 
REGION &, PERFOR 
FILTER 0 
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R WINDOW IS IN 
M REGION & MODE 
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DETERMINE MODE FILTER | 916 

WINDOW 5IZE 
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FOR Z = O TO 5, INITIALIZE THE FOLLOWING: 
DISPARITY COUNT [x+Z] = OO OO OO OO 
( EACH DISPARITY COUNT [x+Z] HAS 4 BINS, EACH BIN 
REPRESENTING THE OCCURRENCE OF EACH DISPARITY 

IN THE RESPECTIVE MODE FILTER WINDOW 
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PERFORM THE FOLLOWING FOR 
EACH IMAGE ELEMENT IN EACH 
ROW AND COLUMN OF REGIONS 1 
AND 2 
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FETCH DISPARITY DATA FROM 
EXTREMAL INDEX [x] [y] WITHIN THE 
MODE FILTER WINDOW 



ADD COUNT BIT(S) TO EACH 
DISPARITY COUNT BIN IN DISPARITY 

COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY 
WITHIN THE MODE FILTER WINDOW 
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IF END OF ROW, 
NEXT ROW 
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PERFORM THE FOLLOWING FOR 
EACH IMAGE ELEMENT IN EACH 
ROW AND COLUMN OF REGIONS 3 
AND 4 



FETCH DISPARITY DATA FROM 
EXTREMAL INDEX [x] Q/] WITHIN THE 
MODE FILTER WINDOW 
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ADD COUNT BIT(S) TO EACH 
DISPARITY COUNT BIN IN DISPARITY 

COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY 
WITHIN THE MODE FILTER WINDOW 
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FOR Z = O TO 5, PERFORM THE FOLLOWING: 
REGION 3: INITIALIZE MODE FILTER WINDOW SUM_Z 
REGION 4: UPDATE MODE FILTER WINDOW SUM_Z 
SUM_Z = SUM_ Z + DISPARITY COUNT [x+Z] 
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NEXT COLUMN, OR 
IF END OF ROW, 
NEXT ROW 
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RETURN 
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MOPE FILTER 
( REGION 5) 
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PERFORM THE FOLLOWING FOR EACH IMAGE 
ELEMENT IN EACH ROW AND COLUMN OF REGION 5 



FETCH DISPARITY DATA FROM EXTREMAL INDEX [x] [y] 
WITHIN THE MODE FILTER WINDOW 



X 



ADD COUNT BIT(S) TO EACH DISPARITY COUNT 
BIN IN DISPARITY COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY WITHIN 
THE MODE FILTER WINDOW 
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FOR Z= O TO 5. UPDATE MODE FILTER WINDOW SUM _Z: 
SUM_Z = SUM_Z + DISPARITY COUNT [x+Z] 



INITIALLY SET 
EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = SUM_Z OF LEFTMOST MSB BIN 



DETERMINE THE DISPARITY WITH THE 
GREATEST COUNT BY COMPARING THE BINS. 
FOR Z = O TO 5, DO THE FOLLOWING: 
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EXTREMAL INDEX RESULT [x] [y] = EXTREMAL INDEX 
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NEXT COLUMN, OR 
IF END OF ROW. - 
NEXT ROW I 
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MODE FILTER 
( REGION 5) 
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EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = 5UM_Z OF LEFTMOST MSB BIN 
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<=>! 

EXTREMAL INDEX = 4*Z + 1 
EXTREMAL VALUE = SUM_Z OF 5EC0ND MSB BIN 
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EXTREMAL INDEX = 4*Z + 2 
EXTREMAL VALUE = SUM_Z OF THIRD MSB BIN 
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EXTREMAL INDEX = 4*Z + 3 
EXTREMAL VALUE = SUM_Z OF LSB BIN 







FIG. 41(D) 
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MODE FILTER 
( REGION 6) 



PERFORM THE FOLLOWING FOR EACH IMAGE 
ELEMENT IN EACH ROW AND COLUMN OF REGION 6 
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FETCH DISPARITY DATA FROM EXTREMAL INDEX [x] M f 
WITHIN THE MODE FILTER WINDOW 
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ADD COUNT BIT(S) TO EACH DI5PARITY COUNT 
BIN IN DISPARITY COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY WITHIN 
THE MODE FILTER WINDOW 
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FOR Z= O TO 5, UPDATE MODE FILTER WINDOW SUM _Z: \f 
SUM_Z = SUM_Z + DISPARITY COUNT [x+Z] 
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INITIALLY SET 
EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = SUM_Z OF LEFTMOST MSB BIN 
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DETERMINE THE DISPARITY WITH THE 
GREATEST COUNT BY COMPARING THE BINS. 
FOR Z = O TO 5, DO THE FOLLOWING: 



953 

V 



¥ 



FIG. 42(A) 



MOPE FILTER 
( REGION 6) 





DISP 


DISPARITY COUNT fx+Zl 




O 


M 


\oo\oo oo oo 




1 


IV1 

L X J 


oo\oo\oo oo 




2 


Txl 


oo oo \oo\oo 




3 




oo oo oo\oo\ 




4 


[x+1] 


\oo\oo oo 00 




5 


[x+1] 


OO I oo 1 on nn 




6 


[x+1] 


oo oo[og\oo 




7 


[x+1] 


oo oo oo[oo\ 




& 


[x+2] 


loo loo oo oo 




9 
10 


[x+2] 


oo |oo loo oo 


>55 


[x+2] 


oo oo|oo|oo 


*^ 1 


11 


[x+2] 


oo oo oo[oo\ 




12 


[x+3] 


|oo|oo oo oo 




13 


[x+3] 


oo\oo\oo oo 




14 


[x+3] 


oo oo\oo\oo 




15 


[x+3] 


oo oo oo\oo] 




16 


[x+4] 


|oo loo oo oo 




17 


[x+4] 


oojooloo oo 




13 


[x+4] 


oo oo\oo\oo 




19 


[x+4] 


oo oo oofool 




20 


[x+5] 


loo loo oo oo 




21 


[x+5] 


oo|oo[oo 00 




22 


[x+5] 


oo oo[oo\oo 




23 


[x+5] 


oo oo oo[oo] 



971 



MODE FILTER 
( REGION 6) 
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EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = 5UM_Z OF LEFTMOST MSf5 BIN 



EXTREMAL INDEX = 4*Z + 1 
EXTREMAL VALUE = SUM_Z OF 5ECOND MSB BIN 
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CD- 



EXTREMAL INDEX = A'Z +■ 2 
EXTREMAL VALUE = SUM_Z OF THIRD MSB BIN 
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EXTREMAL INDEX = 4*Z -«- 3 
EXTREMAL VALUE = SUM.Z OF LSB BIN 
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FIG. 42(D) 
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PERFORM THE FOLLOWING FOR 
EACH IMAGE ELEMENT IN EACH 
ROW AND COLUMN OF REGIONS 7 
AND 5 



MODE FILTER 
( REGIONS 7 & <3 ) 



973 



SUBTRACT A BIT FROM DISPARITY COUNT [ x+Z ] 

BASED ON DISPARITY VALUE IN EXTREMAL 
INDEX [ x ] [ y - MODE FILTER WINDOW HEIGHT ] 



T 



FETCH DISPARITY DATA FROM 
EXTREMAL INDEX [x] [y] WITHIN THE 
MODE FILTER WINDOW 



X 



ADD COUNT BIT(S) TO EACH 
DISPARITY COUNT BIN IN DISPARITY 

COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY 
WITHIN THE MODE FILTER WINDOW 
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FOR Z = 0 TO 5, PERFORM THE FOLLOWING: 
REGION 7: INITIALIZE MODE FILTER WINDOW SUM_Z 
REGION B: UPDATE MODE FILTER WINDOW SUM_Z 
SUM_Z = SUM_Z + DISPARITY COUNT [x+Z] 



NEXT COLUMN, OR 
IF END OF ROW, 
NEXT ROW 
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RETURN 
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930 



PI5P 


DISPARITY COUNT fx+ZI 


0 




I on I on oo nn 


1 


[x] 


nn fool on oo 


2 


[x] 


oo oo \oo 1 on 


3 


M 


OO OO QO[ QOj 


4 


[x+1] 


|oo[oo oo oo 


5 


[x+1] 


oo\oo\oo oo 


6 


[x+1] 


oo oo\ ool oo 


7 


[x+1] 


oo oo oofool 




[x+2] 


loo loo oo oo 


9 


[x+2] 


oo\oo\oo oo 


10 


[x+2] 


oo oo[6o\oo 


11 


[x+2] 


oo oo oofool 


12 


[x+3] 


[oo]oo oo oo 


13 


[x+3] 


oo\go}oo oo 


14 


[x+3] 


oo oo[do\oo 


15 


[x+3] 


oo oo oo [ool 


16 


[x+4] 


fooloo oo 00 


17 


[x+4] 


oo\oo\oo oo 


13 


[x+4] 


oo oofoo\oo 


19 


[x+4] 


oo oo oofool 


20 


[x+5] 


looloo 00 oo 


21 


[x+6] 


oo\go\oo oo 


22 


[x+5] 


oo oo[o6\oo 


23 


[x+5] 


oo oo oofool 



FIG. 43(D) 



f START — ' S 



MODE FILTER 
( REGION 9) 



PERFORM THE FOLLOWING FOR EACH IMAGE 
ELEMENT IN EACH ROW AND COLUMN OF REGION 9 



V 



T 



SUBTRACT A BIT FROM DISPARITY COUNT [ x+Z] If 
BASED ON DI5FARITY VALUE IN EXTREMAL V 
INDEX [x][y- MOPE FILTER WINDOW HEIGHT] 



I 
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FETCH DISPARITY DATA FROM EXTREMAL INDEX [x ][ y ] 
WITHIN THE MODE FILTER WINDOW 



If 



T 



ADD COUNT BIT(S) TO EACH DISPARITY COUNT If 
BIN IN DISPARITY COUNT [x+Z] BASED ON THE V 
OCCURRENCE OF EACH DISPARITY 
WITHIN THE MODE FILTER WINDOW 
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FOR Z= O TO 5. UPDATE MODE FILTER WINDOW SUM 
SUM_Z = SUM_Z + DISPARITY COUNT [x+Z] 



INITIALLY SET 
EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = SUM.Z OF LEFTMOST MSB BIN 
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DETERMINE THE DISPARITY WITH THE 
GREATEST COUNT BY COMPARING THE BINS. 
FOR Z = O TO 5, DO THE FOLLOWING: 
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FIG. 44(A) 
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( REGION 9) 
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MODE FILTER 
( REGION 9) 
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EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = SUM_Z OF LEFTMOST MSB BIN 



EXTREMAL INDEX = 4*Z + 1 
EXTREMAL VALUE = SUM_Z OF SECOND MSB BIN 
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EXTREMAL INDEX = 4*Z + 2 
EXTREMAL VALUE = SUM_Z OF THIRD MSB BIN 
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EXTREMAL INDEX = 4*Z + 3 
EXTREMAL VALUE = SUM_Z OF LSB BIN 







FIG. 44(D) 
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MODE FILTER 
( REGION 10) 



PERFORM THE FOLLOWING FOR EACH IMAGE 
ELEMENT IN EACH ROW AND COLUMN OF REGION 10 
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SUBTRACT A BIT FROM DISPARITY COUNT [ x+Z] BASED ON DISPARITY 
VALUE IN EXTREMAL INDEX [ x ][ y- MODE FILTER WINDOW HEIGHT] 



FETCH DISPARITY DATA FROM EXTREMAL INDEX [ x ][y ] 
WITHIN THE MODE FILTER WINDOW 





ADD COUNT BIT(S) TO EACH DISPARITY COUNT 
BIN IN DISPARITY COUNT [x+Z] BASED ON THE 
OCCURRENCE OF EACH DISPARITY WITHIN 
THE MODE FILTER WINDOW 
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FOR Z= O TO 5, UPDATE MODE FILTER WINDOW SUM Z: 
SUM_Z = SUM_Z- DISPARITY COUNT [x+Z-MODE FILTER WINDOW WIDTH] 
SUM_Z= SUM_Z+ DISPARITY COUNTTx+Z] 
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INITIALLY SET 
EXTREMAL INDEX = 4*Z 
EXTREMAL VALUE = SUM_Z OF LEFTMOST MSB BIN 



DETERMINE THE DISPARITY WITH THE 
GREATEST COUNT BY COMPARING THE BINS. 
FOR Z = O TO 5, DO THE FOLLOWING: 
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( REGION 10) 
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MODE FILTER 
( REGION 10) 




EXTREMAL INDEX RE5ULT [x] Q/] = EXTREMA L 1NPEX H 



NEXT COLUMN, OR 
IF END OF ROW, 
NEXT ROW 



1O20 



RETURN \ ^ 
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MODE FILTER 
( REGION 10) 



EXTREMAL INDEX = 4"Z 
EXTREMAL VALUE = 5UM_Z OF LEFTMOST MSB BIN 



EXTREMAL INDEX = 4*Z + 1 
EXTREMAL VALUE = SUM_Z OF SECOND MSB BIN 



(J> 



EXTREMAL INDEX = 4«Z + 2 
EXTREMAL VALUE = SUM.ZOF THIRD MSB DIN 



EXTREMAL INDEX = 4*Z + 3 
EXTREMAL VALUE = SUM_Z OF LSB BIN 
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FIG. 45(D) 
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